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(57) Abstract: An automated analysis system detects malicious code within a computer system by generating and subsequently 
analyzing a behavior pattern for each computer program introduced to the computer system. Generation of the behavior pattern is 
accomplished by a virtual machine invoked within the computer system. An initial analysis may be performed on the behaviour 
pattern to identify infected programs on initial presentation of the program to the computer system. The analysis system also stores 
behavior patterns and sequences with their corresponding analysis results in a database. Newly infected programs can be detected 
by analyzing a newly generated behaviour pattern for the program within reference to a stored behavior pattern to identify presence 
of an infection or pay load pattern. 
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Computer Immune System and Method for 
5 Detecting Unwanted Code in a Computer System 

PRIORITY APPLICATION NOTICE 

This application claims priority from United States provisional patent 
application Serial No. 60/218,489, filed July 17, 2000, which application is 
10 hereby incorporated by reference in its entirety. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to the field of computer security and 
15 specifically to the detection of computer programs that exhibit malicious or 
self-propagating behavior including, for example, computer viruses and 
trojans. 

2. Discussion of the Related Art 

20 Detection of viruses has been a concern throughout the era of the 

personal computer. With the growth of communication networks such as the 
Internet and increasing interchange of data, including the rapid growth in the 
use of e-mail for communications, the infection of computers through 
communications or file exchange is an increasingly significant consideration. 

25 Infections take various forms, but are typically related to computer viruses, 
trojan programs, or other forms of malicious code. Recent incidents of e-mail 
mediated virus attacks have been dramatic both for the speed of propagation 
and for the extent of damage, with Internet service providers (ISPs) and 
companies suffering service problems and a loss of e-mail capability. In many 

30 instances, attempts to adequately prevent file exchange or e-mail mediated 
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infections significantly inconvenience computer users. Improved strategies for 
detecting and dealing with virus attacks are desired. 

One conventional technique for detecting viruses is signature scanning. 
Signature scanning systems use sample code patterns extracted from known 
5 malicious code and scan for the occurrence of these patterns in other program 
code. In some cases program code that is scanned is first decrypted through 
emulation, and the resulting code is scanned for signatures or function 
signatures. A primary limitation of this signature scanning method is that 
only known malicious code is detected, that is, only code that matches the 

10 stored sample signatures of known malicious code is identified as being 

infected. All viruses or malicious code not previously identified and all viruses 
or malicious code created after the last update to the signature database will 
not be detected. Thus, newly created viruses are not detected by this method; 
neither are viruses with code in which the signature, previously extracted and 

15 contained in the signature database, has been overwritten. 

In addition, the signature analysis technique fails to identify the 
presence of a virus if the signature is not aligned in the code in the expected 
fashion. Alternately, the authors of a virus may obscure the identity of the 
virus by opcode substitution or by inserting dummy or random code into virus 

20 functions. Nonsense code can be inserted that alters the signature of the virus 
to a sufficient extent as to be undetectable by a signature scanning program, 
without diminishing the ability of the virus to propagate and deliver its 
payload. 

Another virus detection strategy is integrity checking. Integrity 
25 checking systems extract a code sample from known, benign application 

program code. The code sample is stored, together with information from the 
program file such as the executable program header and the file length, as 
well as the date and time of the sample. The program file is checked at 
regular intervals against this database to ensure that the program file has not 
30 been modified. Integrity checking programs generate long lists of modified 
files when a user upgrades the operating system of the computer or installs or 
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upgrades application software. A main disadvantage of an integrity check 
based virus detection system is that a great many warnings of virus activity 
issue when any modification of an application program is performed. It is 
difficult for a user to determine when a warning represents a legitimate attack 
5 on the computer system. 

Checksum monitoring systems detect viruses by generating a cyclic 
redundancy check (CRC) value for each program file. Modification of the 
program file is detected by a variation in the CRC value. Checksum monitors 
improve on integrity check systems in that it is more difficult for malicious 

10 ' code to defeat the monitoring. On the other hand, checksum monitors exhibit 
the same limitations as integrity checking systems in that many false 
warnings issue and it is difficult to identify which warnings represent actual 
viruses or infection. 

Behavior interception systems detect virus activity by interacting with 

15 the operating system of the target computer and monitoring for potentially 
malicious behavior. When such malicious behavior is detected, the action is 
blocked and the user is informed that a potentially dangerous action is about 
to take place* The potentially malicious code can be allowed to perform this 
action by the user. This makes the behavior interception system somewhat 

20 unreliable, because the effectiveness of the system depends on user input. In 
addition, resident behavior interception systems are sometimes detected and 
disabled by malicious code. 

Another conventional strategy for detecting infections is the use of bait 
files. This strategy is typically used in combination with other virus detection 

25 strategies to detect an existing and active infection. This means that the 
malicious code is presently running on the target computer and is modifying 
files. The virus is detected when the bait file is modified. Many viruses are 
aware of bait files and do not modify files that are either too small, obviously a 
bait file because of their structure or have a predetermined content in the file 

30 name. 
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It is apparent that improved techniques for detecting viruses and other 
malicious types of code are desirable. 

SUMMARY OF THE PREFERRED EMBODIMENTS 
5 One aspect of the present invention provides a method for identifying 

presence of malicious code in program code within a computer system, 
including initializing a virtual machine within the computer system. The 
initialized virtual machine comprises software simulating functionality of a 
central processing unit and memory. The virtual machine virtually executes a 

10 target program so that the target program interacts with the computer system 
only through the virtual machine. The method includes analyzing behavior of 
the target program following virtual execution to identify occurrence of 
malicious code behavior and indicating in a behavior pattern the occurrence of 
malicious code behavior. The virtual machine is terminated at the end of the 

15 analysis process, thereby removing from the computer system a copy of the 
target program that was contained within the virtual machine. 

Another aspect of the present invention provides a method for 
identifying the presence of malicious code in program code within a computer 
system* The method includes initializing a virtual machine within the 

20 computer system, the virtual machine comprising software s i mula t ing 

functionality of a central processing unit, memory and an operating system 
including interrupt calls to the virtual operating system. A target program is 
virtually executed within the virtual machine so that the target program 
interacts with the virtual operating system and the virtual central processing 

25 unit through the virtual machine. Behavior of the target program is 

monitored during virtual execution to identify presence of malicious code and 
the occurrence of malicious code behavior is indicated in a behavior pattern. 
The virtual machine is terminated, leaving behind a record of the behavior 
pattern characteristic of the analyzed target program. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 illustrates a behavior pattern generated according to the 
analytical behavior method, showing the behavior pattern for code that is not 
infected and is infected with a computer virus. Each bit may be a flag 
5 indicating an action. The total stream of bits is a value indicative of the 
behavior of the program. 

FIG. 2 shows a block diagram of components used in a preferred 
implementation of the analytical detection method. 

FIG. 3 schematically illustrates the COM file format, used as an 
10 example of the function of the program structure extractor and program 
loader. 

FIG. 4 illustrates an interface of the virtual PC to various program file 

formats. Before virtualization can take place, the program loader preferably 

extracts the correct entry point, code and initialized data from the program 
15 file. The file offset to the entry point code is given in the program header and 

varies depending on the type of file that contains the program. 

FIG. 5 schematically illustrates the virtual PC memory map after 

loading a binary image (.COM) program and after loading a MZ-executable 

program. To virtualize the code in the desired manner, the structure of the 
20 virtual PC and its memory map contains the same information as it would if 

the code was executed on the physical PC which runs the virtual machine 

containing the Virtual PC. 

FIG. 6 provides a detailed diagram showing components of a preferred 

implementation of the Virtual PC. The virtual PC contains the same 
25 components that are used in a physical computer, except that all Virtual PC 

components are simulated in software running as a virtual machine on a 

physical computer. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
30 A particularly preferred embodiment of the present invention provides 

an automated analysis system that detects viruses and other types of 
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malicious code within a computer system by generating and subsequently 
analyzing a behavior pattern for each computer program introduced to the 
computer system* New or modified computer programs are analyzed before 
being executed by the computer system. Most preferably the computer system 
5 initiates a virtual machine representing a simulation of the computer system 
and the virtual machine executes the new or modified computer program to 
generate a behavior pattern prior to the new computer program being 
executed by the physical computer system. An initial analysis is performed on 
the behavior pattern to identify infected programs upon initial presentation of 

10 * the program to the computer system. The analysis system also stores 

behavior patterns and corresponding analysis results in a database. Newly 
infected programs can be detected by subtracting the stored behavior pattern 
for that program from a newly generated behavior pattern, and analyzing the 
resulting pattern to identify an infection or payload pattern associated with 

15 malicious code. 

A variety of different terms are used in programming to describe 
different functional programming subunits. At different times and for 
different programming languages subunits of various sorts have been called 
functions, routines, subprograms, subroutines and other names. Such 

20 designations and the context or differences they represent are not significant 
to the present discussion and so this discussion is made simply in terms of 
programs, intending the term program to refer to functional progra mm i n g 
units of any size that are sufficient to perform a defined task within a 
computer system or computing environment. Such specialized functions as 

25 those performed by macros within certain word processing programs, 

including for example, in Visual Basic macros for Microsoft Word documents, 
are included within this general discussion. In this sense, individual 
documents may be considered to be programs within the context of this 
discussion. 

30 For convenience and brevity, this discussion references viruses in the 

known sense of that term as being a self-propagating program generally 
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undesired in the infected computer system. As used here, the term Windows 
is intended to reference any of the personal desktop operating systems sold by 
the Microsoft Corporation under the Windows brand name. The term PC or 
personal computer is used, unless specifically modified to indicate otherwise, 
5 to indicate a computer system based on the well-known x86 architecture, 
including those machines that presently are based on the microprocessor sold 
by Intel Corporation under its Pentium brand name and successors to that 
microprocessor and architecture. This discussion is provided to illustrate 
implementation of aspects of the invention. Aspects of the present invention 
10 find application in a range of different computer systems in addition to the 
illustrated personal computer systems. 

The present inventor has analyzed the behavior of a variety of different 

* 

viruses and other malignant source code. Certain general characteristics of 
viruses have been identified. A virus needs to infect other programs and 

15 eventually other computers to propagate. Viruses consequently include 
infection loops that copy the virus into another executable program or 
sometimes into documents, in the exemplary case of Visual Basic macro 
viruses. Viruses and trojans generally contain payloads. The payload allows 
the virus to affect the infected system or communicate its presence. A payload 

20 might be, for example, a message that pops up to announce the virus or a 
malicious function that damages the infected computer, for example by 
corrupting or erasing the data on the hard disk or by altering or disabling the 
BIOS within the BIOS flash or EEPROM. 

Another common characteristic of viruses is that the virus becomes 

25 resident in the memory. DOS viruses need to copy themselves into memory 
and stay resident. Most viruses do not use the obvious terminate and stay 
resident (TSR) call but instead use a procedure that copies the virus into high 
memory. The virus then can directly modify the data in the high memory 
blocks. La an additional aspect of this infection scheme, the interrupt vector is 

30 modified to point at memory blocks that have been modified by the memory 
resident virus or other malignant procedure. These modified memory blocks 
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store the infection procedure. Windows specific viruses bump themselves into 
ringO, for example using a callgate or DPMI call, and go resident in a system 
utility such as the system tray. 

These behaviors are characteristic of a virus and are not, in the 
5 aggregate, characteristic of other, non-malignant programs. Consequently, a 
program can be identified as a virus or infected with a virus if it possesses 
certain ones of these behaviors, certain collections of these behaviors or all of 
these behaviors. In preferred embodiments of the present invention, the 
occurrence of these behaviors or combinations of the behaviors is indicated by 

10 collections of bits in a behavior pattern data set representing behavior 

characteristic of the infected program. An example of behavior patterns for a 
normal and an infected file are illustrated in FIG. 1. 

In preferred embodiments of the present invention, the behavior of a 
newly loaded or called program is analyzed in a virtual machine that 

15 simulates a complete PC, or a sufficiently complete PC, in software and it is 
that virtual PC that generates the behavior pattern. The virtual PC simulates 
execution of the new or modified program, simulating a range of system 
functions, and the virtual PC monitors the behavior of the suspect program 
and makes a record of this behavior that can be analyzed to determine that 

20 the target program exhibits virus or malignant behaviors. The result of the 
virtual execution by the virtual machine is a behavior pattern representative 
of the new program. As discussed in greater detail below, the behavior 
pattern generated by the virtual PC identifies that a program is infected with 
a virus or is itself a virus. An advantage for the use of virtual execution and 

25 analysis of new programs for viruses is that the virtual machine is virtual and 
so, if the virtualized new program contains a virus, only the virtual machine is 
infected. The infected instance of the virtual machine is deleted after the 
simulation, so the infection is incomplete and the virus does not propagate. 
The behavior pattern survives the deletion of the virtual machine, allowing an 

30 analysis program to identify the existence of the virus and of the infection 
within the new program. 
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Most preferably, each time a new program is analyzed a new instance of 
the virtual machine is generated, free of modification by any previously 
virtualized programs including any earlier analyzed viruses. The new 
program then is run on the new instance of the virtual machine preferably 
5 followed by initiation of a modified interrupt caller procedure, described in 
greater detail below. While the virtual machine is executing the new program 
in cooperation with the modified interrupt caller procedure, the virtual 
machine monitors all system calls, DPMI/DOS interrupts and I/O port 
read/write (r/w) operations, setting bits in the behavior pattern register 

10 according to the observed behaviors. It is these bits in the behavior pattern 
that are retained after the simulation is complete and the virtual PC has been 
terminated. The bits stored in the behavior pattern register are the behavior 
pattern and indicate whether the virtually-executed program includes 
behaviors indicative of the presence of a virus or other malignant code. 

15 The modified interrupt caller procedure calls the interrupts that the 

program being analyzed has modified within the virtual PC and generates a 
behavior pattern for each of those interrupt service routines as well. This 
allows particularly preferred embodiments of the present invention to identify 
certain types of viruses that initially modify only the interrupt service 

20 routines and do not begin propagating until the modified interrupt or 

interrupts are called by another program. By allowing the various interrupt 
service routines in the virtual machine to be modified and then analyzing the 
modified interrupts, these embodiments of the invention can detect this 
delayed propagation mechanism. 

25 In some presently preferred embodiments, only the static, final version 

of the behavior pattern is analyzed. It is possible, and in some circumstances 
desirable, to monitor the sequence in which the bits in the behavior pattern 
register are set. The order in which the behavior pattern bits are set provides 
additional information allowing identification of additional virus behaviors, 

30 Tracking of the order in which the behavior pattern bits are set is 
accomplished within the virtual machine. 
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Preferred implementations of the analytical behavior method (ABM) 
proceed by extracting a behavior pattern and sequence from a modified, new, 
unknown or suspect program. The behavior pattern is preferably used to 
analyze the behavior of the unknown program to determine if the behavior of 
5 the unknown program is malicious. Identification of malicious behavior in 
this maimer allows identification of virus carrying files prior to infection of the 
host computer system. The behavior pattern can also be stored in a database 
and the virtual machine can subsequently analyze the behavior of the 
program following modification to determine if its functionality has been 
10 * modified in a suspect (malicious) manner. This provides post-infection 
analysis. 

The described analytical behavior method differs from conventional 
virus detection methods in that it does not match program code to a set of 
stored patterns as do signature scanners and integrity checkers. Rather, a 

15 virtual machine is used to generate a behavior pattern and a sequence. The 
generated behavior pattern does not change significantly between version 
updates, but does change dramatically when a virus infects a program. For 
example, a word processor will still behave like a word processor when the 
program is replaced or updated with a new version of the program but the 

20 word processor changes significantly when the word processor is infected with 
a virus. The differences reflected in the behavior patterns are illustrated in 
FIG. 1. When a word processor is infected with a file infector computer virus, 
the word processor now opens executable files and inserts the viral code into 
them, thereby infecting additional files. This is clearly reflected in the 

25 illustrated behavior patterns. 

In particularly preferred embodiments of the invention, the analysis 
procedure specifically targets infection methods such as, but not limited to, 
the insertion of code to other executables or documents, submitting code to 
other applications to be transmitted or stored, insertion of code into high 

30 memory blocks and the modification of memory control blocks. Preferred 
implementations of the analysis method further look for destructive content, 
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such as, but not limited to, functions that overwrite disk areas or the BIOS 
ROM, or delete files or directories. Most preferably, the analysis makes an 
exception and does not identify as infected a program whose other behavior 
characteristics indicate that the program is a development tool or software 
5 debugging tool and where the modifying behavior is an integral part of the 
tool's normal function. A viral infection of a development tool can be detected 
where an expressed function is not part of the tool's normal function, that is, 
within the development process. Both active (1) and inactive (0) flags present 
in the behavior pattern are significant in this analysis, as well as the sequence 

10 in which actions take place. 

In accordance with preferred embodiments of the present invention, the 
virtual machine or virtual PC represents a simulation of a complete computer 
system. A complete computer system preferably includes an emulated central 
processing unit (CPU), emulated memory, input/output (I/O) ports, BIOS 

15 firmware, operating system and the operating system data areas. This stands 
in contrast to simple emulation of a processor, in which only the processor 
processes are emulated. In emulation, program instructions are converted 
from their native form to a stream of instructions that perform the same 
function on a different hardware platform. Some signature scanning software 

20 employs emulation to decrypt the body of a suspect program before the suspect 
program is scanned for signatures. In virtualization, the entire computer is 
simulated including operating system calls, which are not actually executed 
but seem to the calling program to perform the desired functions and return 
the correct values as if they were executed. 

25 As discussed above, the virtual PC includes a CPU, memory, I/O ports, 

a program loader, and the operating system application program interface 
(API's) entry points and interface. Using such a complete virtual PC is 
particularly preferred because it gives the analytical behavior method a high 
level of control over the virtualized program, including over the sophisticated 

30 direct calls to the operating system API. The virtualized program is not given 
access to any of the facilities of the physical machine, thereby avoiding the 
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risk that the potential virus or other malicious code escapes from the 
controlled environment to infect the host computer system. 

FIG. 2 provides an overview of the preferred analytic hehavior method 
architecture including the relationship between the virtual machine and 
5 components of the host computer system. Program code is delivered to the 
ABM engine and analysis system by direct access to the hard disk through I/O 
port bit manipulation, hooking into the operating system file system or by 
sequentially scanning the hard disk. The program code is checked against the 
database for Tcnown' files. If the file is new or modified, it is processed. The 
10 ' resulting behavior signature is analyzed or compared and stored. A virus 

warning is returned when analysis shows that the file contains malicious code. 
The analytical behavior method preferably includes: (1) file structure 
extraction; (2) change detection; (3) virtualization; (4) analysis; and (5) 
decision. 

15 Before the program can be virtualized, the file format containing the 

target program has to be evaluated. The entry point code is extracted and 
loaded into the virtual computer's memory at the correct simulated offset. In 
a physical computer this function would be performed by the program loader 
function, which is part of the operating system. The operating system can 

20 execute programs that are held in a collection of different file formats, such as: 

DOS 1.0 and/or CP/M COM Binary image file, loaded at lOOh in memory, 

maximum size: 64K. 

DOS 2.0 - DOS 7.1 EXE MZ-type executable, header determines CS:IP 

25 of load address. 

Windows 3.0 executables NE-type executable which contains both the 

DOS MZ-header pointing at a DOS code area 
and a New Executable (NE) header 
containing the entry point of the Windows 
30 (protected mode) code. NE files are 

segmented. 
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OS/2 executables 

5 

10* 

32-bit executables 

15 

OLE Compound Files 

20 
25 

Binary Image 

30 



LE /LX type executable which contains both 
the DOS MZ-header and DOS code area and a 
protected mode section which is determined 
by the LE-header following the DOS code 
segment. Linear Executable (LE) files are 
used in Windows 3 for system utilities and 
device drivers. LE files are segmented. LX 
files incorporate some differences in the way 
the page table is stored and are intended for 
the OS/2 operating system. LE files are 
segmented and the segments are paged. 
PE-type executable which contains both the 
DOS MZ-header and DOS code area and the 
Portable Executable header containing the 
entry point and file offset of the protected 
mode code. PE files are segmented. 
OLE compound files (COM) are document 
files that can contain executable format 
streams, usually referred to as Macros, All 
office components incorporate Visual Basic for 
Applications, as does Internet Explorer 
versions 4 and 5. Windows98 systems can 
execute Visual Basic code directly from a 
script file. The Visual Basic code is compiled 
and stored in a stream, which is paged 
according to its file of&et references stored in 
a linked list in the file header. 
A binary image is used for the boot sector and 
Master Boot and Partition table. Both the 
boot-sector and the MBR contain executable 
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code which is loaded into memory at 0:7C00 
during the start-up process. 
Driver files System Drivers are stored as a binary image 

with a header. The header contains 
5 information about the drivers stored within 

the file. Multiple drivers can be stored within 
the same file. 

The virtual computer loader function is capable of dealing with the file 

10 formats and binary image files shown above. The loader function is performed 
by virtualizing the operating system program loader and so varies depending 
on the operating system used in the host computer. The file structure analysis 
procedure looks in the file header and file structure to determine the file 
format, rather than using the file extension because file extensions are 

15 unreliable in general use. The .EXE formats described above therefore include 
DLL, AX, OCX and other executable file format extensions. 

Compound document files can contain executable streams such as 
Visual Basic code or macros. The structure of a compound document file is 
illustrated in the diagram shown in FIG. 3. The header of a compound 

20 document file contains a linked list (or File Allocation Table) which is 

referenced in a directory structure that points to the entry point of the linked 
list. Each entry in the linked list refers to the next entry and a file offset. A 
value of -1 in the linked list indicates the end of a chain. Streams exist out of 
blocks, which may be scattered anywhere in the file in any order. In 

25 particularly preferred embodiments of the invention, code extracted from a 
compound document file is passed through a Visual Basic decompiler before it 
is presented to a Visual Basic emulator. Not all compound document files 
contain compiled Visual Basic code. Hypertext markup language (HTML) and 
Visual Basic Script (VBS) files can contain Visual Basic Script code as text. 

30 This code is preferably extracted and treated as a Visual Basic stream within 
the virtual machine. 
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The NE /PE /LE executable file formats are similar in complexity, 
except that no linked list is used; rather these file formats use a segment or 
page table. The PE file format is based on the COFF file specification. FIG. 4 
illustrates how these file formats interface with the preferred virtual PC in 
5 accordance with certain embodiments of the present invention. In evaluating 
how aspects of the preferred virtual PC interfaces to a particular file, the file 
loader preferably decides if the file presented is a document file or a binary 
file. 

After the file format has been evaluated and the entry point-file offset 
10 has been calculated, the file is opened and the virtual machine reads the 
relevant code into memory as a data stream. The length of the code is 
calculated from fields in the header of the file. This information is passed to 
the virtual program loader. The virtual program loader uses information in 
the file header to load the extracted code at the correct simulated offset in a 
15 virtual memory array. 

A memory mapping utility maps the virtual memory map to the offset 
for the file type that is virtualized: 

DOS (CP/m) binary image files (.COM) offset CSrlOOh 

20 DOS (2.0 up) Executable format files (MZ-EXE) offset CS:IP from header 
Windows NE, PE, LE offset CO00000O+CS:IP 

from header 

Binary Image MBR, Boot sector code offset 0:7C00h 

Document COM files, HTML and VBS files no specific offset, 

25 VBA code 

The Loader utility dynamically assigns physical memory to the virtual 
computer memory array each time a program is virtualized, and proceeds to 
build a new virtual machine. Each virtual machine contains a BIOS data 
30 area, a filled environment string area, DOS data area, memory control blocks, 
program segment prefix area, the interrupt vector table and descriptor tables. 
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The firml structure of the virtual machine depends on the type of program that 
is virtualized. Each vixtualized program therefore runs in a fresh memory 
area, created when that program is loaded into the virtual PC. Previous 
instances, where infected programs may have heen virtualized, therefore 
5 cannot affect the performance of subsequent programs. The virtual machine 
is shut down and its memory resources are released when the virtualized 
program terminates and the virtual machine completes assembly of the 
behavior pattern for the target, virtualized. 

FIG. 5 illustrates how the virtual memory is configured for (COM) 

10 ' binary image files and DOS program (MZ-EXE) files. The memory map and 
mapper utility are adjusted depending on the file type. 

The program loader simulates the loader functions of the operating 
system and creates system areas that represent similar system areas in the 
physical computer. This is particularly advantageous functionality because 

15 the code under evaluation most preferably runs in the same manner as if 
executed on a physical computer system. The virtualized program is executed 
by fetching instructions from the virtual memory array into a pre-fetch 
instruction queue. The instructions in the queue are decoded and their length 
is determined by their operational parameters. 

20 The instruction pointer is incremented accordingly so that the 

instruction loader is ready to fetch the next instruction. The virtual machine 
determines from the r/m field of the instruction parameters where data on 
which the instruction operates is to be fetched. The data fetch mechanism 
fetches this data and presents the data to the logic unit, which then performs 

25 the operation indicated by the code. The destination of the processed data is 
determined from the parameters of the instruction code. The data write 
mechanism is used to write the processed data to emulated memory or the 
emulated processor register set. This process accurately reflects what takes 
place in a physical CPU (central processing unit). 

30 All areas of this process are simulated, as generally illustrated in PIG. 

6. The memory exists as an array of 400 Kbyte elements into which all 
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memory accesses are mapped by a memory mapping mechanism. The size of 
the memory array may be adjusted in future implementations to accommodate 
larger programs. The video display is simulated from a system viewpoint as 
128 Kbyte of memory mapped between A000:0 and BFFF:F (inclusive) in the 
. 5 virtual computer's memory map. The standard IBM PC iiiput/output area is 
simulated as an array of 1024 bytes representing I/O ports 0-3FFh* The CPU 
is simulated by performing the same low-level functions as the physical CPU, 
but in high-level software. 

The operating system is implemented as an area in the memory array of 
10 700h bytes containing the BIOS data fields, the DOS data area, Memory 

Control Blocks and DOS devices. The interrupt vector table takes up the first 
1024 (400h) positions in the memory array as it would in a physical PC. The 
DOS interrupt structure is implemented as simulated functions that return 
the correct values and by filling the memory array with the correct values 
15 expected by simulating DOS functions. 

The operating system is implemented as a virtual API (VAPI) that 
simulates the results returned by all operating system API's. 

During the visualization process, flags are set in the behavior pattern 
(Tstruct) field as the functions represented by those fields are virtualized. The 
20 sequence in which these functions are called is recorded in the sequencer. The 
behavior pattern therefore matches closely the behavior of the program under 
evaluation to the behavior of that program in a physical PC environment. 
Simulated interrupt vectors modified during the process of executing the 
virtualized program are called after program visualization terminates, thus 
25 acting as applications that would call such interrupt vectors in a physical 
computer following modification of these vectors. 

To illustrate this functionality, consider the following set of operations 
might be performed in operation of the analytical behavior method: 

30 Search for the first EXE file in this directory ;set FindFirst Flag 

(Tstruct Structure) 
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Ib this a PE executable (examine header)? 

If not, jump fax 

Else: Open the executable file 



jsetEXEcheckElag 



5 



Write to the section table 



Search for the end-of-file 



;set EXEaccess Flag 
;set EXEwrite Blag 
;set EXEeofFlag 



Write to file 



;set EXEwrite Flag 



Close file 



Search next EXE file 



;set EXEFindNext Flag 



10 Bit+i 64— 



l 



Returned: 0010 0100 1010 1010 1001 0101 0010 1111 0010 1010 0010 0100 0100 1001 0000 
0101 

Value: 24AA 952F2A24 4905 
Sequencer. 21,22, 23 ) 24,26 ) 29,3E,1,36,38 I 3B,3, 9,C,F,13,16,lA,lC,lE, 2B.2D, 30,32,34, 

15 

The resulting behavior pattern is: 24AA952F2A244905 

The behavior pattern contains flags that indicate that the user has not 
had the opportunity to interact with this process through user input (the 

20 userlnput flag is not set). The sequencer contains the order in which the bits 
were set, identifying the infection sequence shown above. Therefore this 
observed behavior is most likely viral. 

Many viruses are encrypted, polymorphic or use 'tricks' to avoid 
detection by signature scanners. Wherever such 'tricks' are used, the behavior 

25 pattern points more obviously towards a virus since such tricks are not 

normally used in normal applications. In any case, preferred implementations 
of the present invention require that an infection procedure be present to 
trigger a virus warning to avoid false positive warnings. Encrypt viruses 
are no problem, because the execution of the code within the virtual machine, 

30 which generates the behavior pattern, effectively decrypts any encrypted or 
polymorphic virus, as it would in a physical PC environment. Because all 
parts of the virtual computer are virtualized in preferred embodiments, and at 
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no time is the virtualized program allowed to interact with the physical 
computer, there is no chance that viral code could escape from the virtual 
machine and infect the physical computer. 

The change detection module compares existing files at 6 levels to 
5 determine if the file was analyzed previously: 

• The file is the same (entry point code, sample, file-name and file-size are 
the same). 

• The file is not in the database (new file), 

• The behavior pattern matches a stored pattern. 

10" • The file's entry code is modified. The behavior pattern is binary subtracted 
from the previous stored pattern. The resulting bit pattern is analyzed. 

• The file's entry code, CRC and header fields are the same, but the file is 
renamed. No other fields are modified. 

• The file's behavior pattern is found in the database and matches a known 
15 viral behavior pattern. 

• The file's behavior pattern is found in the database and matches a known 
benign behavior pattern. 

The program is virtualized if the executable part of the file is modified. 
20 A file that does not contain modified executable code cannot contain a virus, 
unless the original file was infected. If this is the case, a previous analysis 
would have detected the virus. When an existing program is updated, its 
function remains the same, and therefore its behavior pattern closely matches 
its stored behavior pattern. If the altered bits indicate that an infection 
25 procedure has been added then the file is considered as infected. 

Two detection mechanisms operate side-by-side, both using the 
behavior pattern: 
JPre-infection detection 

This is the most desirable case. In pre-infection detection, the behavior 
30 pattern is analyzed and is found to represent viral behavior for those new or 
modified programs introduced to the system. The program file under 
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evaluation can be repaired by removing the virus or erased if the virus 
infection proves too difficult to remove or if parts of the original code were 
overwritten. The infected program has not yet been executed on the physical 
PC at this time and so nothing need be done to repair the physical PC after 
5 discovery of the virus. 
Post-infection detection 

Post-infection detection takes place in cases when initial infection is 
missed by pre-infection detection. A virus could be missed by pre-infection 
detection when it does not perform any viral function on first execution and 

10 does not modify interrupt vectors that point to an infection routine. This is 
the case with so-called slow infectors and similarly behaving malignant code. 
In post-infection detection the virus is caught the moment it attempts to infect 
the first executable on the PC. The file hook mechanism detects this 
attempted change to an executable (including documents). The ABM engine 

15 then analyzes the first executable program and finds that its behavior pattern 
is altered in a manner indicating that a virus is active. 

Database Structure: 

File ED area: Behavior pattern, program name, file size and path. 

20 Repair Structures Header fields, section table and relocation tables. 

Segment tables Size and Offset of each section in the section table 

(Windows programs only). 

Macro viruses in documents are treated as if they were executables, 
25 The original Visual Basic code is recovered by decryption (where applicable) 
and reverse compiling the Visual Basic document (COM) stream. The 
resulting source code is neither saved nor shown to protect the rights of the 
original publishers of legitimate Visual Basic software. After virtualization 
the source code is discarded. 
30 One drawback to the described virus detection system is that the initial 

analysis is slower than pattern scanning. This drawback is more than offset 



20 



WO 02/06928 



PCT/US01/19142 



by the advantages of the system. Using file system hooking means all new 
files are reported and analyzed 'on the fly* in background. This means that 
once a computer is virus-free, a complete scan is typically not required again, 
unless the protection system has been deactivated during a period in which 
5 new programs have been installed. In signature scanning based protection 
systems, the computer needs to be completely rescanned every tiriie the virus 
signature database is updated. Unaltered files are not again virtualized when 
the user initiates subsequent disk scans, so that the process is at least as fast 
as pattern scanning, but with a higher degree of security. The stored 

10 information also helps to repair viral damage to files or system areas, securing 
complete or effectively complete recovery in most cases. 

In tests of a prototype implementation ABM system, the combination of 
pre-infection (96%) and post-infection detection (4%) resulted in 100% 
detection of all known viral techniques, using a combination of new, modified 

15 and well-known viruses. Other methods detected only 100% of known viruses 
and scored as low as 0% for the detection of new, modified and unknown 
viruses* No exact figure can be quoted for tests involving signature scanner 
based products. The results for such products are a direct representation of 
the mix of known, modified and new, unknown viruses; e.g. if 30% of the virus 

20 test set is new, modified or unknown then the final score reflected dose to 30% 
missed viruses. No such relationship exists for the implementations of 
preferred aspects of the present system, where the detection efficiency does 
not appreciably vary for alterations of the presented virus mix* 

The present invention has been set forth with reference to certain 

25 particularly preferred embodiments thereof. Those of ordinary skill in the art 
will appreciate that the present invention need not be limited to these 
presently preferred embodiments and will understand that various 
modifications and extensions of these embodiments might be made within the 
general teachings of the present invention. Consequently, the present 

30 invention is not to be limited to any of the described embodiments but is 
instead to be defined by the claims, which follow. 



21 



WO 02/06928 



PCT/US01/19142 



I claim: 

1. A method for identifying presence of malicious code in program 
code within a computer system, the method comprising: 

initializing a virtual machine within the computer system, the virtual 
5 machine comprising software simulating functionality of a central processing 
unit and memory; 

virtually executing a target program within the virtual machine so that 
the target program interacts with the computer system only through the 
virtual machine; 

10 * analyzing behavior of the target program following virtual execution to 

identify occurrence of malicious code behavior and indicating in a behavior 
pattern the occurrence of malicious code behavior; and 

terminating the virtual machine after the analyzing process, thereby 
removing from the computer system a copy of the target program that was 

1 5 contained within the virtual machine . 

2. The method of claim 1, wherein the virtual machine simulates 
functionality of input/output ports, operating system data areas, and an 
operating system application program interface. 

20 

3. The method of claim 2, wherein the virtual machine further 
includes a virtual Visual Basic engine. 



4. The method of claim 2, wherein virtual execution of the target 
25 program causes the target program to interact with the simulated operating 

system application program interface. 

5. The method of claim 1, wherein the target program is newly 
introduced to the computer system and not executed prior to virtually 

30 executing the target program. 
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6. The method of claim 1, wherein after a first instance of a first 
program is analyzed by the virtual machine and a first behavior pattern is 
generated and stored in a database within the computer system, the method 
further comprising: 
5 determining that the first program is modified; 

analyzing the modified first program by executing the modified first 
program in the virtual machine to provide a second behavior pattern; and 

comparing the first behavior pattern to the second behavior pattern. 

10 ' 7. The method of claim 6, wherein a new behavior pattern is 

generated each time the first program is modified. 

8. The method of claim 6, wherein introduction of malignant code 
during modification of the first program is detected by comparing the first 

1 5 behavior pattern to the second behavior pattern. 

9. The method of claim 6, wherein the first behavior pattern is 
substantially similar to the second behavior pattern when the modified first 
program is a new version of the first program. 

20 

10. The method of claim 1, wherein the behavior pattern identifies 
functions executed in the virtual execution of the target program, the method 
further comprising tracking an order in which the functions are virtually 
executed by the target program within the virtual machine. 
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11. A method for identifying presence of malicious code in program 
code within a computer system, the method comprising: 

initializing a virtual machine within the computer system, the virtual 
machine comprising software simulating functionality of a central processing 
5 unit, memory and an operating system including interrupt calls to the virtual 
operating system; 

virtually executing a target program within the virtual machine so that 
the target program interacts with the virtual operating system and the virtual 
central processing unit through the virtual machine; 
10 monitoring behavior of the target program during virtual execution to 

identify presence of malicious code and indicating in a behavior pattern the 
occurrence of malicious code behavior; and 

terminating the virtual machine, leaving behind a record of the 
behavior pattern characteristic of the analyzed target program. 

15 

12. The method of claim 11, wherein the record is in a behavior 
register in the computer system. 

13. The method of claim 11, wherein after a first instance of a first 
20 program is analyzed by the virtual machine and a first behavior pattern is 

generated and stored in a database within the computer system, the method 
further comprising: 

determining that the first program is modified; 

analyzing the modified first program by executing the modified first 
25 program in the virtual machine to provide a second behavior pattern; and 

comparing the first behavior pattern to the second behavior pattern. 

14. The method of claim 13, wherein a new behavior pattern is 
generated each time the first program is modified. 
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15. The method of claim 13, wherein introduction of malignant code 
during modification of the first program is detected by comparing the first 
behavior pattern to the second behavior pattern. 

.5 16. The method of claim 13, wherein the first behavior pattern is 

substantially similar to the second behavior pattern when the modified first 
program is a new version of the first program. 

17. The method of claim 13, wherein the behavior pattern identifies 
10 functions executed in the virtual execution of the target program, the method 
further comprising tracking an order in which the functions are virtually 
executed by the target program within the virtual machine. 
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